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Abstract — Recently, Suyari has proposed a generalization of 
Shannon-Khinchin axioms, which determines a class of entropies 
containing the well-known Tsalis and Havrda-Charvat entropies 
[H. Suyari, IEEE Trans. Inf. Theory, vol. 50, pp. 1783-1787, 
Aug. 2004]. In this comment we show that the class of entropy 
functions determined by Suyari's axioms is wider than the one 
proposed by Suyari and give a counterexample. Additionally, 
we generalize Suyari's axioms characterizing recently introduced 
class of entropies obtained by averaging pseudoadditive informa- 
tion content introduced in [V. Ilic and M. Stankovic, "Comments 
on "Nonextensive Entropies derived from Form Invariance of 
Pseudoadditivity"" Submited, 2012]. 

Index Terms — Information measure, nonextensive entropy, 
nonextensive system, pseudoadditivity, Shannon- additivity, Tsal- 
lis entropy, Weierstrass function 



[GSK4] generalized Shannon additivity: if 
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Pij > 0, Pi = 2_,Pij, p(j\i) 

Vi = l,...,n, Vj = 1, ...,mj, 
then the following equality holds: 
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Remark 1: [GSK1]-[GSK4] reduces to [SK1]-[SK4] for 
q = 1. As shown in [2], Si is Shannon entropy, i.e. 
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I. Generalized Shannon-Khinchin Axioms 

In this section we review generalized Shannon-Khinchin 
axioms. We discuss the proof for unique class satisfying the 
axioms proposed by Suyari 0] and give a counterexample. 



A. Suyari's theorem 

Let A„ be the n-dimensional simplex, 



A, 



(Pi, ■ ■ ■ ,Pn) Pi > 0,^,Pi = 1 



(1) 



and let M + denotes the set of positive real numbers. 

For a function S q : A„ M+, q e K+, n E N, 
we define the following Shannon-Khinchin (SK) axioms 
[GSK1]~[GSK4]: 

[GSK1] continuity: S q is continuous in A„ and with respect 
to q e M+; 

[GSK2] maximality: for any n e N and any (p%, ■ ■ ■ ,p n ) S 



A, 



Sq(pi,...,p n ) < S q (-, ...,-); 

n n 



[GSK3] expandability: 



S-i(pi,...,p n ,0) = S-i(pi,...,p n ); 



(2) 



(3) 
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where k > 0. Because of [GSK1], we have 

n 

lim S q = Si = -k\^ pi Inpi. 
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(7) 



Theorem 1: Let S q : A„ 



q e M+, n £ N be a 
function which is not identically equals to zero for n > 1 
and satisfies [GSK1]-[GSK3] and the following generalized 
Shannon additivity axiom for q 6 M + . Then, S q : A„ — > K + , 
n G N, is uniquely determined with 

Er=i Pi 



Sq{pi 
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■Pn 



,Pn. 



e A„ 



(8) 

and (j)(q) satisfies 



1; 



for qeM+\ {1} and (j> 1 , . 
the following properties i)-iv): 

i) 4>(q) is continuous and has the same sign as q 

ii) lim g _}.i (f)(q) — 0, and (f){q) ^ for q ^ 1; 

iii) there exists an interval (a, b) £ R + such that a < 1 < b 
and 4>{q) is differentiable on the interval (a, 1) U (1, 6); 

iv) there exists a positive constant k such that 



lim 9 _».i 



d<t>(q) 
dq 



According to Suyari's proof, the form <[8J is uniquely 
determined by solving functional equation (|5]l from [GSK4] 
and by using the continuity with respect to p as assumed 
in [GSK1]. Property (i) follows from maximality condition 
[GSK2]. The continuity with respect to q from [GSK1] implies 
condition (ii). [GSK4] is used only for proof of the basic 
case q = 1, at which [GSK1]~[GSK4] reduce to Shannon- 
Khinchin axioms. 
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To satisfy (|7), Suyari, using the fact that numerator 

n 

1 — Pi is differentiable with respect to q, concludes that 

properties (iii) and (iv) must be satisfied for 4>{q). However, 
(0 will actually be satisfied iff: 



lim • lim IZI^A 



\imS q (j?i,...,p n , ..... 

q-H q-+l <p(q) q-H 



lim TTT I7TT ' nm I - ^ Pi m Pi 

g-H 0(<?) - 0(1) <?^1 1 ' ' 



i=l 



n 



i=l 



-k ■ > ' pi In pi 



i.e. iff 



lim 



m - 0(1) 



(9) 



(10) 



(We have used L' Hospital's rule to show that 
lim (1 - £™ =1 P;)/(g - 1) = - J27=iP* ln Pi-) Accordingly, 

q->-l 

properties (iii) and (iv) should be replaced with 
iii') <f>(q) is differentiable in q — 1 and 



dm 



dq 



(11) 



Hence, the function <fi(q) need not be differentiable in a 
neighbourhood of q = 1, but only in q = 1. In the following 
subsection we construct the function which has these two 
properties. 

Condition (iii') describes a class of functions which are not 
characterized by conditions (iii)-(iv). One example is shown 
in the following subsection. Although Suyari's conditions (iii)- 
(iv) may appear as conditions which do not require differen- 
tiability of function 0(g) in 1 and therefore describe a class of 
functions not characterized by condition (iii'), that is actually 
not the case, as the following Lemma shows. 

Lemma 1: Let / be a continuous function on (a, b) and 
suppose that xq E (a, b) is such that f'(x) exists for all xq £ 
(a, x ) U (x Q ,b). If lim x ^. Xo /'(x) = L, then f(x ) = L. 

Proof: For sufficiently small h € M, h > 0, / is continu- 
ous on [xo, xo + h] an d f'{%) exists for all x £ (xq, x + h). 
Conditions for the Mean Value Theorem are fulfilled, therefore 
there exists rjh £ (xq , xq + h) such that 



/(.T +h)- f(x ) = h ■ /'(%). 



Hence 



lim 
= lim 



fjxp + h)- f(x ) 
h 

h-f'(Vh) 



lim f( Vh ) = L. 



Similarly, it can be proven that f'_(xo) 
f'(x ) = L. 



i, and therefore 



B. Counterexample 

The Weierstrass function is a well known example of 
nowhere differentiable continuous function [3]. It is defined 
with: 

oo 

(b k TTx) , 



W{x) 



^ a k cos i 

fe=0 



(12) 



where 0<a<l,6isa positive odd integer, ab > 1 + 3tt/2 
and igR, The Weierstrass function is bounded, since 



\W(x)\ < 



OO 

^a fc |cos(& fc 7rx) 

k=0 



fc=0 



W(0) < oo, 



(13) 

where W(0) = 1/(1 — a). Using the Weierstrass function we 
construct <p(q), which satisfies properties (i), (ii) and (iii'), but 
not properties (iii) and (iv). 

q-1 W(q - 1) + 2 • W(0) 



(14) 



k 3 ■ W(0) 

Since W(x) is continuous and W(x) +2W(0) > according 
to ( fT3l , 4>(q) satisfies properties (i) and (ii). Moreover, 

d(j>{q) 



dq 



= lim 

=i g^i 



0(q) - 0(1) 



— lim 



M 4 (15) 



and function 0(g) satisfies property (iii'), 

However, function <fi(q) does not satisfy property (iii) from 
Suyari's theorem since it is differentiable only in q = 1. 
Oppositely, the function 

W(g - 1) + 2 • W(0) 



1 



0(g) = 



i 



(16) 



q-l k 3 • W(0) 

should be differentiable for some 5 / 1 as a product of 
differentiable functions, further implying differentiability of 
W(q — 1), which is impossible since the Weierstrass function 
is nowhere differentiable. 

II. New axiomatic system 

In this section we review the class entropies obtained as 
averaging of pseudoadditive information content introduced in 
[|4]. After that we generalize Suyari's axiomatic system, which 
uniquely determines the class of entropies derived in [4j. 

A. Entropy as expected information content 

Theorem 2: Let I q (p) be a function of two variables q £ 
M + and p £ (0, 1], which satisfies the following axioms 
[SO] Ji 0) = -klnp, fc>0, 

[SI] I q is continuous with respect to p £ (0, 1] and q £ R + , 
[S2] I q (p) is convex with respect to p £ (0, 1] for any fixed 

q £ R+ 

[S3] There exists a function : M + — » M such that 

Iq (PlP2) = ^ (Pi) + (P2) + (q) ■ Iq (Pi) ■ Iq ip%) 

for any P11P2 £ (0, 1], (f>(q) ^ for q / 1 and 0(g) is 
continuous [j. 

'The axiom [S3] from |4| is actually not the same [S3] from the present 
paper, but it is equivalent. It can be obtained if we set <j>(q) = ip(q)/k, where 



<P ■ - 



is continuous. 
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Then, the unique nontrivial solution is given by 

M^^-(^-l), (17) 

where A: is a positive constant and 

(a) a (q) is continuous with respect to any q G M + , 
a(l) = 0, a(q) + f or q ^ 1 and 



lim — — 



(18) 



(b) it holds that 



f(-oo,0] for 0(g) >0 
a(9)e \ [0,1] for 0(g) <0. (19) 

Remark 2: Note that condition a(g) 7^ for g ^ 1 ensures 
that information content is not identically equals zero for some 

q- 

Nonextensive entropy of distribution p, S q (p), is defined as 
the appropriate expectation value of I q , 



Sq (p) = E q , p [I gS 



(20) 



The expectation is chosen so that the maximality principle is 
satisfied: 

S q ( Pl ,...,p n )<S q (^,...,^). (21) 
The simplest case is the trace form expectation: 

n 
i=l 

In this case the maximality condition is satisfied if e q (p) ■ I q (p) 
is concave as shown in [5|. For the information content (fTTT i 
one possible choice is e q (p) = p~ a ^i) +1 in which case we 
obtain 



Sq (p) 



1 - £ v i 

i=l 



*(?) + ! 



(22) 



Note that the trace form expectation operator (f20b represents 
the generalization of expectation operator which is used in ax- 
iom [GSK4] for a(q) = l — q. In the following subsection we 
will give the axiomatization of entropy ( 1221 by generalization 
of the axiomatic system [GSK1]~[GSK4] from section iFAl 
based on expectation operator ( f20t . 

B. New axiomatic system 

Theorem 3: Let S q : A„ ->• R+, q G K+, n G N be a 
function which is not identically equals to zero for n > 1 
and satisfies [GSK1]-[GSK3] and the following generalized 
Shannon additivity axiom for q G K + . 

[gsk4] generalized Shannon additivity: if 



Vi = l,...,n, Vj = 1, ...,m,i (23) 



Py>0, Pi = y^Py, p{j\l) = -^- 

3=1 Pl 



and a : R + — > R is a continuous function, then the following 
equality holds: 

Sq(pil, ■ ■ ■ ,Pnm n ) 

n 

= S q {pi, . . . ,p n ) + ^2p^ a[q)+1 S q (p(l|«), ■ • . ,p(mi\i)) , 

(24) 



i=l 



where a(g) is continuous, a(l) = and a(q) ^ for q ^ 1. 
Then, 5 g : A„ — )• M + , n G N, is uniquely determined with 

s g (pi,..., P „) = — ^4 ■ < 25 ) 

where (pi, . . . ,p n ) G A„, g G R + and 

(a) (g) is continuous with respect to any q G K + , 
0( g ) ^ for g ^ 1 and 0(1) = [OP] and 

lim -M = -k. (26) 



g-+l 0(g) 



(b) it holds that 



Mc J(-°°> ] for 0(g) >0 

[0,1] for 0(g) <0. (2?) 

Remark 3: The axiom [gsk4] reduces to [GSK4] if we 
choose a{q) = 1 — q. 

Remark 4: The conditions for a(q) and 0(g) are identical 
to the conditions from subsection IH-AI Accordingly, the class 
of entropy functionals $25[ is the same as the class d22b . 

Proof: By straightforward repetition of steps from to 
Suyari's proof, the form ( 1251 ) is uniquely determined by 
solving functional equation d24l) from [gsk4] and by using the 
continuity with respect to p as assumed in [GSK1]. 

The properties of 0(g) given by (a) straightforwardly follow 
from continuity of S q and a(q). Before proving the equality 
(l26l i. we make the following note. The condition (|26| | is 
necessary and sufficient for satisfaction of the limit property 
0, 



lim 

g-j-l 



-a(g) + l 



<X<?) 



i=l 



k-pi\npi. (28) 



To prove this, let us introduce 7(g) = p~ a ^ — 1. Using 
7(g) — > when q 1 and (1 + t)~ — > e when t — > 0, 
we have 

g-s-i 0(g) g-n 0(g) a(g) 

lnp 



lim a{q) 



i^ x 4>{q) ln(l + 7 (g))^i) 



lim , [^} ■ lnp. 



g^l 0(g) 

For pi = p = 1/n d28l reduces to 

l_p-«(g) 
lim —— = 

g-s-i 0(g) 



-k ■ lap, 



(29) 



(30) 
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and according to d29l l, the condition ( f26T > is necessary. On the 
other hand, 

lim 1 U =f; = KmJ2Pf - (31) 

q-yl (j){q) W) 

and d29l ) impiles the sufficiency of condition (l26b . 

Property (b) can be proven by taking the second derivative 
of I q (p) with respect to p, which should be nonnegative for 
any fixed q s K + , since I q (p) is convex by [T2]. Thus, we 
can derive a constraint 

• (a(q) - 1) > (32) 

The constraint ( 1321 is satisfied if 

(-oo,0] U [l,oo) for qb(q) > 
[0, 1] for qb(q) < 0. 




(33) 



As shown in [4), if a(q) and 4>{q) are continuous and the 
equality d26l i holds, then a(q) £ [1, oo), and the equality 
follows, which proves and theorem. 



III. Conclusion 

In this paper, we reviewed generalized Shannon-Khinchin 
axioms proposed by Suyari in (T). 

We discussed Suyari's proof of a unique class of functions 
satisfying those axioms, pointed out the oversight, supported 
it with a counterexample and gave the correction of the 
proof. Suyari's paper has been widely cited and a similar 
oversight has been noticed in some of them. For example, in 
|6| the author follows the same procedure in generalizations 
of Hobson's axioms, which leads to the similar incorrectness. 

In addition, we generalize Suyari's axioms characterizing 
the recently introduced class of entropies obtained by averag- 
ing pseudoadditive information content introduced in [4|. 
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